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ABSTRACT 

Some of the major findings of CSE's (Center for the 
Study of Evaluation) Test Use in Schools Project are synthesized and 
interpreted. The Project incorporated f ieldwork arid survey techniques 
to answer questions about the kinds of tests teachers admin ister in 
their classrooms , the kinds of inf ormat i on teachers need from tests 
to make decisions about their students, and how teachers use test 
information to make decisions . Data collected during the study are 
described and interpreted f rom the standpoint of teachers' routine 
assessment needs arid practices. The classroom teacher is seen as a 
practical reasorier arid decision maker who makes cliriical use of 
assessment information to diagnose , prescribe , and monitor 
instruction . The tests teachers use most frequently are those that 
fit their practical ci rcumstances : formal and informal measures they 
themselves construct or seek out for the information they provide; 
and curriculum embedded tests that come with commercial or district 
materials. Policy implications germane to the development of testing 
programs are presented and features of a testing system that could be 
di rectly useful to teachers are descr ibed . ( LC ) 
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In This Issue 



Some of the major findings of CSE's Test Use in Schools 
Project are synthesized and interpreted. CSE's nation-wide 
study, funded by the National Institute of Education and 
conducted between 1979 through 1982, incorporated 
Jj ©J dwork and s u rv ey_tec hniques to _a_n s we r_s_u_c h_q u est ions 
as: what kinds of tests and other assessment devices do 
teac hers a dm injster in the] r c I ass room s?_ wha t k i rid so f j n : 
formation do teachers need from the tests and other de_- 
vices they use to make decisions about t heir students? 
how do teachers use the information as they make these 
decisions? 

_ Don Dorr-Bremme, a Senior Research Associate at 
CSE, provides answers to these and related questions. He 
describes the data collected during the study and inter- 



■ Points o< vhnv or opinions sUlod m this docti 
mimt do not necessarily represent otlicidl NiE 
position or policy 

prets them from the standpoint of teachers' routine 
assessment needs and practices. In this interpretation, 
which draws on ethnomethodological concepts and socio- 
logical stud ies of p ro fess ional groups, the clas sroom 
teacher is seen as a practical reasoner and decision maker 
who rri a_k es c Ij ri i caj u se _oJ aAsessm e n t Information to diag- 
nose, prescribe, and monitor instruction^ 

From ^h i s _d a t a- b ase d i n it e rjjr e t a t i ion ,_ Dorr- B re m rri e p_r e : 

sents some policy implications germane to the develop- 
ment of testing programs. He describes some of the 
•features of a testing system which, in addition to any 
broader applications that may be intended, can be directly 
useful for teachers as they go about the business of pro- 
viding instruction and finding out how well their students 
have learned. 
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In the 1980's, testing issues confront educational policy- 
makers at all organizational levels. The nation's invest- 
ment in school achievement testing is enormous, and the 
amount and variety of testing continues to grow. Public ac- 
countability mandates for minimum competency 
or proficiency testing, evaluation requirements for govern- 
iPJlht-fL Lhdecl L^d u^atfori programs, and judici al _dec i siori s 
defining increased responsibilities for public schools are 
9 n !y_ some of the factors t h at have f uel ed wi despread 
debate about the nature and purposes of testing in the 
schools. 

The quality.oJ available tests has becomes in alter of 
controversy (CSE, 1979; The Huron Institute, 1978). Critics 
have indicted the validity of tests and attacked them as 
biased (Cabello, in press; Perrone, 1978). They have decried 
the arbitrariness of current testing practices (Baker, 1978), 
accused testing of narrowing the curriculum, and ques- 
tioned the value of today's tests for t h e c h a n g i ng functions 
of American education (Tyler, 1977). Professional and ad- 
vocacy groups representing educators, parents, arid stu- 
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dents have taken positions on testing. At least one major 
teacher's organization, for example, called for a morato- 
rium on the use of standardized tests. 

In response to these challenges, advocates of testing 
have asserted that tests can and do serve a variety o1 jm- 
po rta nt purposes . Th ey ha v em a] n t aj ned _t hat achievement 
testing promotes high standards for learning, facilitates 
So>eac^ 

the improvement of curriculum and instruction, and helps 

the pubMc hold schools accountable. 

But as testing has proliferated and controversy has 
gro wn, I i ttle em piri cai i n form a tion has been avai lable o n 
the assessment of student achievement as it Is actually 
practiced in American classrooms. A small number of 
studies have indicated teachers' circumspect attitudes 
toward and limited use of one type of achievement mea- 
sure — the norm-referenced, standardized test (e.g., Afra- 
sian, 1979; Boyd, et al., 1975; Goslin, Epstein, & Hilloch, 
1965; Resnick, 1981; Salmon-Cox, 1981; Stetz & Beck, 
1979). Another small body of research has suggested that 
students' social performances in school settings figure 
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significantly in educators [judgments of students; scholas 
tic competence (e;g:, Gicoorel & Kitsuse. 1963; Erickson & 
Shul tz, 1 982 ; Lei it e r , 1 974; R i s t , 1 970). But studies such as 
these have offered only brief glimpses of teachers' reason- 
ing andpractices in evaluating student achievement. What 
methods and instruments do teachers routinely employ. in 
making sense of how their students are doing academic 
ally? How do teachers think and reason about assessing 
their students learning? Such questions as thesis have 

gone largely un addressed. . .. 

In this context, the Center for the Study of Evaluation's 



(CSE) Test Use in Schools Project has. begun io provide 
basic newjnformation on classroom achievement assess- 
ment across the United States, this article draws upon 
findings from the project s various phases presenting an 
interpretive summary of some practices and kinds of rea- 
soning which teachers routinely employ as they evaluate 
their students achievement in the basic ski I i s First how- 
ever, the research itself will be briefly reviewed. 



An Overview of the Test Use in Schools Project 

Conducted from 1979 through 1982 (with sortie secondary 
data analysis still unaerwayj, CSE's test use research pro- 
ceeded from broad definitions of test and testing. It encom- 
passed a wide range of types of formal assessment mea 
sures, including commercially produced norm- and crite- 
rion referenced measures, tests of minimal competency or 
functional literacy; and district-, school-, and teacher-con- 
structed iests._L.ess_ form a I _ me a s u r_e_s_ for gauging s_t u d en. t 
achievement, such as teachers' observations of and inter- 
na c t ion s_ wit h j e a rne r s , were m c I u d ed as well. Within th is 
broad domain, inquiry focused on achievement assess- 
ment practices and us es in Readin g/Engli s h and Mathe- 
matics as carried out in public schools at the upper- 
elementary and high school levels 

During the project's first year of exploration and plan- 
ning, comprehensive, semi-structured interviews were con- 
ducted in nine schools, three each in three school districts 
located in different states and geographic regions of the 
country, The districts and the elementary a n_d_ secondary 
schools visited varied in size and demographic setting: 
E a c _h_ g f _t h e i n t e r v i e w s las ted a bout an hou r a n d f b c u s ed 
on assessment practices and uses of test results in the 
bas ic skills su bject s ment io ne d abb ye . Inclu ded amb ri g 
the interview respondents were 44 classroom teachers (22 
elementary and 22 secondary), as well as principals depart' 
ment chairpersons, counselors, and instructional special- 
ists. Their remarks were tape recorded, transcribed, and 
coded using inductively developed categories. 

Also during the first year, data collected in an earlier 
CSE study of testing and test use (Yeh, 1978) were reana- 
lyzed. These data were gathered by self-administered ques- 
tionnaires in 1? s_chopl_s_in five California school districts 
some 256 teachers in grades K-6 responded: 

_A_ literature review accompanied the two exploratory re : 

search efforts in. the project's first year. 

In the project s second year these activities informed 
the design of a nation-wide survey of teachers and prin- 
cipals Survey recipients were drawn in a multi step 
process First a nationally representative sample of some 
114 districts was selected. This sample was stratified on 
the basis of district socio-economic status, enrollment 
size, minimum-competency testing policy, urban-sub- 
urban rural locale, and geographic region of the country 
From within these districts, size permitting, two 
elementary and twohigh schools, were randomly chosen 
using a procedare that facilitated (where possible) in- 
clusion of_ schools serving both higher_and lower-income 
populations: Finally, in each of these schools, principals 
received directions for randomly drawing four teachers for 
inclasi.on in the study. The principal and each of the four 
participating teachers received questionnaires that 
elicited detailed information on individual and school 
assessment practices as well as on related contextual and 

attitudinal data. . . 

Returns were obtained from 220 principals. 486 upper 
elementary teachers, and 365 high school English and 
math teachers. (The overall rate of return was 54% of the 
desired 2 000 respondents.) To correct for differential rates 
by stratification sampling cells and to approximate a na- 
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t i on 3 l.l y "representative distribution of respondents, 
weightings were applied in all analyses:_ 

Fi'nahy, while the first two years _of j_he_PL9ject focused 
ontesting practices and Jhe uses of assessment results; 
the third year concentrated pn.tesjirig^ costs. .Case study 
research produced portraits, of the direct and indirect 
costs of basic sRMLs testing^ in two school districts (one 
large and urban, another small and suburban), including 
detailed descriptions" of the testing costs in one elemen- 
tary. schooJ within each district.. . .. 

Major findings from the Test Use in Schools Project are 
available in a number of technical reports and articles. In 
addition to the Yen (1978) study cited earlier, Lazar- 
Morrison and others (1980) have presented the main 
themes identified in the review of test use literature: Major 
findings of jhe exploratory, first year interviews have been 
discussed by Burry, et al: [1981): Barry, et. ai. (1982) and 
He/man a r ld^P9 rr -?I6mme J1983) have described and 
analyzed some of the early survey results.. And the case 
studies of testing costs appear in Dorr-Bremme, et al. 
(1983). 

This article elaborates on these early project reports by 
synthesizing and nterpretmg findings from the reanalysis 
of Yen's (1978) data, from the project's first year in- 
terviews, and from the national survey. It draws on con- 
cepts from ethnomethodology (Garfinkel, 1967; Mehan & 
Wood, 1975) and from sociological studies oj professional 
groups to describe and analyze how teachers routinely 
think about and carry out the assessment of student 
achievement: 

The Firidingsj How Teachers Routinely Think 
and Act in Assessing Student Achievement 

How do teachers routinely think and act in assessing stu- 
dent achievement? In answer to that question, the findings 



of the CSE Test Use Project suggest that teachers _think 
and act both as practical reasbriers and decision makers 
and as clinicians That \s t as they go about the basmess of 
determining how the students in their class(es) are doing 
academically: 

• they orient their assessment activitiesjd the p_racU : 
cal tasks tr ey have to accomplish in their everyday 
routines, and do so in light of the practical contingent 
cies and exigencies that they face on the job: . 

• A h d a s_ t h ey d o L lh e y ma ke sense of student s ' aca- 
demic performances clinically. They take into acdurit 
alj the '^data'^at hand "in t hi s p a rt i c u I a r s it u at ion ; ' ' 
Then they interpret that data based on what •'every- 
one who is a member of the world of educational 
practice knows about what things mean and how 
things work in classrooms. 

That teachers do think and act in these ways when they 
are carrymg ouj student assessment is evident in the fol- 
lowing Test Use Project findings. 

( 1 ) In intervie vvs, teach ers report their uses of test re- 
sults as serving most heavily the functions that are 
most central to teaching-as-practiced. 

In the on-site interviews, teachers were able to de- 
scribe with minimal constraints how they u s ed t es t resu It s 
and information from other assessment techniques. The 
purposes they most frequently cited were those that con- 
stitute their most essential, routine work: deciding what to 
teach and how to teach it to students of different achieve- 
ment levels; keeping track of how students are progress- 
ing and how they (the teachers) can appropriately adjust 
their teaching; and evaluating and grading students on 
their performance (see Table 1). Clearly, these are the day- 
to-day routines of teaching.. .... 

Less frequently, respondents mentioned using assess- 



Table 1 

Types of Tests and the Uses of Their Results (Interview Data) 
(Ceils show the number of times the 44 interviewed teachers freely cited each use for each type of test) 



TEST TYPES 



Uses 

Planning Instruction 

Referral/Placement 

Within Classroom Grouping 

& Individual Placement 
Holding Students Accountable 

for Work, Discipline 

Assigning Grades 

Monitoring Students' Progress 

Counseling & Guiding Students 

Informing Parents 

Reporting to District Officials, 

School Board, etc: 
Comparing Groups of Students, 

Schools, etc. 
Certifying Minimum Competency 
Total Use 

Explicit Statements of Non-use 
TOTAL CITATIONS 



13 
11 
4 



1 

0 
3 
0 

0 



0 
33 
10 
43 



10 
0 
18 



17 
14 
0 
0 
1 



0 
63 

0 
63 



0 
19 

0 
19 
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13 
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66 


0 
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18 
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12 


51 
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10 
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22 
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0 


0 
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10 
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16 


101 


11 


74 
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21 


12 


10 


17 


101 


11 
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351 
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m_e_nt resuitb in deciding to reier students who need 
special .instruction and to counsel, advise; and direct stu- 
dents _These are impo_rtant_ teaching responsibilities, _but 
ones tnat serve to support or facilitate more basic instruc- 
tional work. 

. Use of test results in sach tasks as comparing groups 
of students and reporting to people at higher levels of the 
school aid. district organizational hierarchy were rarely 
mentioned by teachers ^hese uses of test results are not 
in themselves unimportd^ The reporting of scores to the 
school board, for instance, may be of considerable mo- 
ment for superintendent or even prmcinais. Cprnpajjng 
achievement across classrooms or schools is of central 
concern to _d i s t ri c t administrators and program coord ma 
tors: And these reports and comparisons may ultimately 
affect teachers daMy professionaMives Itjs not that these 
activities are inherently trivial, then, that makes them non- 
salient for teachers it is their remoteness from teachers 
routine tasks that makes them so. 

(2) The means of assessment on which most teachers 
rely most heavily are those which facilitate the 
accomplishment o f their routine activities under the 
exigencies they face. 

Reanaiysis of data *ram the earlier _CSE test use study 
(Yen, 1978) found among 256 elementary school teachers 
surveyed, that of aij the tests they gave o thenr students? 
teacher-made tests figured more heavily than others in 
teachers^ classroom decisionTnaking The reanaiysis also 
discovered that for assessing stt^ant progress teachers 
relied heavily on interactions with and observations of 
students. 



_ On site interviews supported and elaborated these find 
iags The 44 teachers interviewed volunteered (collectively) 
351 uses for mhe types of assessment techniques (Again, 
refer to Table "Lj they reported more uses (IQij arid more 
kinds of uses for their own, self-constructed tests and 
major ..assignments, e.g., essays, reports,. _etc_. t _t ha n_ rpr 
any other assessment type: JJses for other, less formal, 
teacher developed strategies— j)eer eva I uajions. oral exer- 
cises, conferences with students, consultations with stu- 
dents former teachers ± etc —were mentioned next most 
frequently (74 times); followed by curriculum-embedded 
tests available commercially or constructed by the local 
school districts (63. times). Furthermore, for schools in 
each of the three districts studied, the aforementioned 
types of assessment were those in which students spent 
the greatest proportion of their total assessment time. 

National survey results dramatically confirmed the pen 
erality of Yen's (1978) and the project's first-year, fieldwork 
findings, for both elementary and secondary teach ers_ 
Teachers were asked to rate information from various 
so u rces ( t e s ts and others) as crucia I, i mportan t , somew hat 
important, unimportant, or not avaiJable for conducting 
four routine decision making activities — initial planning^ 
initial student grouping, grouping changes, and giving 
grades. For initially grouping or placing students in a cur 
riculum, for changing students from one group or curric- 
ulum to another, and for assigning grades, nearly every 
survey respondent reported that *rry own observations 
and students' class work" was a crucial or important 
source of information. (See Tables 2 and 3.) The great 
majority o f respondents also indicated that the results of 
the tests they themselves developed also figured as 



Table 2 

Elementary Teacher Uses of Assessment information for Different Decision-making Purposes 
(Percentages of teachers sui veyed reporting use of this information as crucial or important. for the specified purpose) 



Planning Teaching Initial Grouping Changing a Student 
a! Beginning of or Placement of from one Group or 



Deciding on 
Students' Report 



Source/Kind of information 

Previous teachers' comments, 
reports, grades 

Students' standardized test scores 

Students' scores on district cori : 
tinuum or minimum competency 
tests 

My previous teaching experience 

Results of tests included with 
curriculum being used 

Results of other special 
placement tests 

Results of special tests developed 
or chosen by my school 

Results of tests I make up 

My own observations and students' 
classroom work 
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School Year Students 

Reading Math Reading Math Reading 



Curriculum to Another Card Grades 



57 

57 
51 

94 
x 



52 

54 
47 

94 

x 



62 

57 
50 



78 
61 



80 
96 



55 

52 
45 

x 

67 
56 



86 
97 



55 
45 



83 



56 

78 
99 



Math Reading Math 



53 

39 



82 



52 

85 
99 



17 
20 



x 

75 



42 

92 
98 



16 

18 



x 

77 



42 
95 
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Table 3 



High School Teacher Uses of Assessment Information for Different Decision-making Purposes 
(Percentages of teachers surveyed reporting use of this information as crucial or important for the specified purpose) 



Source/Kind of Information. 



Plan n;n_g_Te aching 
at Beginning of 
School Year 



English Math 



Initial Grouping 
or Placement of 
Students 



Changinf a Student 
from Oiivi Group or 
Curriculum to Another 



English Math English 



Deciding on 
Students' Report 
Card Grades 



Math English Math 



Previous teachers' comments, 28 29 34 40 x 

repo rts, grades 

Students' standardized test scores 47 29 49 30 62 

Students' scores on district con- 48 30 47 36 53 

i'riuijm or minimum competency 
tests 

My previous teaching experience 99 97 x x x 

Results of tests included with x x 45 35 58 

curriculum being used 

Results of other speciaJ x x 42 26 x 

placement tests 

Results of special tests developed x x x x 50 

or chosen by my school 

Results of tests I make up x x 87 77 92 

My own obser.ations and students' x x 99 93 99 

classroom work 



39 
36 

x 

33 
x 

31 

91 

97 



12 

9 



x 

44 



28 

99 
99 



x 

31 



34 

99 
95 



crucial or important in _t_hese _same decisions And many 
elementary school teachers also responded that the "re- 
sults of tests included with the curriculum being used 
figured heavily in their planning for their teaching and in 
placing and changing the placement of students Far lower 
percentages of teachers rated the other types of informa- 
tion listed as crucial and important in carrying out any of 
the three activities. 

Looking over all these findings, it is evident that the 
types of assessment that most teachers rely upon most 
heavily have three characteristics in common: 

• Immediate accessibility teachers can give them 
when they choose and see the results promptly. 

■ Proximity between their intended purposes and 
teachers' pra cticai yet ivi tie s . 

• Consonance, from teachers' perspectives, between 
the content they cover and the content taught. 

Each of these features responds to the exigencies of 
teachers 1 practical circumstances. 

Teachers must accomplish their instructional work— 
initial planning, distributing students, teaching, continued 
planning, evaluating — within a temporal structure to 
which are attached normative expectations. Teaching 
units, marking periods, semesters, school years — these 
and other divisions of school time each have inherent 
points of closure. By those end-points, given amounts. of 
learning are expected to be accomplished; Thus, time 
p res ses ; teachers and their stu d en t s m ust "prog re s s ; ' ' 
decisions most often cannot wait (c:f; dackson, 1968; 
Sarason, 1971; Smith & Geoffrey, 1968). 



Not only is teaching time rapidly moving, it is also very 
full teachers interviewed during both the exploratory field 
work and the third-year costs study were asked to detail 
the time they spent on various job_ related L activities in a 
normal school week; When their estimates were_ aggre- 
gated, elementary tea c h e r s ' est [mate s a v era g ed 357 hour s 
a year spent outside the classroom, or about nine hours 
eac h week d u r ing t he schoo I year. Hi g h school t eac hers, on 
the average, seemed to be spending 6Q0 hours a year, or 
a bout 15 h our s a week on jo b- re I a ted t asks outs ide t h e 
classroom; And, of course, classroom time. i t sel r is con- 
stantly busy. Thus, teachers use means of assessment 
that are immediately accessible— that can be employed at 
the appropriate moment in the flow of on going instruc- 
tion—and for which results are quickly available. 

Teachers also operate in an environment of accounta- 
bility and concern The decisions that they make matter, in 
varying degrees, to students^ educational futures and life 
chances. Minimum competency, laws, as well as court 
suits filed for "failure to educate," testify to the social 
pressures, that bea r u po n _t ea c h e r s . T h a t_ t ea c h er s re cog- 
nize these pressures and strive to act with consonant con- 
cern and effgrtjs evident (e.^., Lort ie, 1 9_75|, Thus, teac hers 
use assessment techniques that in their perspective accu- 
rately m ea s u re w h at h as bet; ji t a U g H it, t h at rri ea s u re t he 
effects of the instruction that they believe they have given. 
And | in (.response to both time and accountability demands, 
as well as to their own concern with assessing accurate y, 
they e_mp]by measures that they believe match With the 
routine activities that they, as classroom teachers, must 
accomplish. 
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Teachers' determination b( which particular tests or 
other assessment. techniques meet ihese last two criteria 
is routinely a practical matter, not a scientific or technj 
cal one. that is, teachers tend to i'se and consult jhe _r_ej 
suits of whatever measures are present in the setting and 
purportedly relevant for the purposes at hand. If such a 
test is unavailable and a practical need is .perceived for 
one, teachers feel competent to construct it The appro 
priateness of these procedures js continually reaffirmed 
'refiexively (Mehan & Wood. 1975 p 8ff ) in the recurrent 
interactional activities of everyone involved in the world of 
schooling 

Throughout the interviews conducted in the first and 
third years of research, teacher comments on the technical 
properties of iests were, with only a handful of exceptions, 
notably absent. Routinely present were remarks which took 
for granted, the technical adequacy of tests and. 
simultaneously, treated their practical features as matters 
of primary interest. Thus both the reanalysis of Yeh s (1978) 
data and the fieldwork found that teachers frequently use 
whatever tests_come^with their curriculum for placement in 
that curriculum Similarly they most often employ self- 
constructed and curriculum embedded unit tests for 
assessing performance on a unit and (ultimately), for 
grading students The exploratory on site visits also 
discovered heavy use bv .istructional specialists (remedial 
reading teachers, teachers of the learning disabled, etc ) of 
readily available normed diagnostic tests,_e g^ the Sucher 
Allred Reading Placement Inventory and the Bergantz 
Inventory of Basic Skills^ for diagnosing l LP cJ^i v i d^u a I learning 
problems and developing inoividualized programs. That 
such tests we_re labeled as appropriate for use in these 
tasks led to their use in accomplishing these tasks. And 
simultaneously and refiexively. their use in accomplishing 
these tasks reaffirmed the appropriateness of their labels,' 

In summary, the assessment techniques teachers use 
most — teacher made tests and assignments curriculum- 
embedded tests, and especially the phenomenological data 
on students' performance that teachers gather everyday in 
the classroom — respond to the practical exigencies 
teachers face and the routine tasks they must accomplish 
And in their use of these means of evaluating student 
achievement, as well as in [heir selection of particular 
measures, teachers reveal themselves as practical rea- 
soners and decision makers in their everyday professional 
lives. 



(3) When test results are differentially important for 
teachers, their importance varies with their re- 
sponsiveness to the practical exigencies that sur- 
round the task at hand. 



As Tables 2 and 3 display, teachers rarely find stan- 
dardized test results important in deciding on stpdents! 
report card grades. Substantially greater proportions of 
teachers, however, report that they do give these test re- 
cults important consideration when it_ comes to planning 
their teaching at the beginning of the year. Standardized 
test scores also figure as crucial or important for many 
teachers as they go about the business of distributing and 
re assigning students_ to instructional groups and curricula. 

In the context of grading, standardized tests have char- 
acteristics that_are_ exactly V e opposite of those assess 
ment results that most teachers r:iy on. most heavily. The 
classroom teachers interviewed, for instance, complained 



'This is not to suggest tnat the edacators in question, never 
abandoned one test in favor of another But when they did so it 
appeared to be_ on jDractical grounds e when it was perceived 
that the. test recurrently "didn't work' for accomplishing the task 
that had to be done: 
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that standardized test scores for their _ current class(es) 
arrived in their hands too late in the school year to be of any 
use In many cases, teachers neve_r_got them for the present 
year s students their results arrived the following fall. Many 
interviewees also noted jhat the scores provided little 
diagnostic information; others pointed out that the content 
of such tests overlapped only partially with what they were 
teaching As they are usually scheduled and employed 
then, standardized tests lack immediacy of accessibility 
Their purposes are not perceived as proximal to teachers; 
everyday tasks (As one respondent put it the/re for 
comparison, not diagnosis of . my kids' weaknesses and 
strengths ) And many teachers perceived a poor fit 
between what they teach and what standardized tests 
cover. 

Nevertheless, in the context of another activity, more 
teachers find results of standardized tests useful* At the 
beginning of the yea_r, teachers can drop into the off ice and 
check the standardized test scores of their new ciass(es) as 
they plan whaj to teach and how to pace their teaching 
through the opening weeks of the year or semester. And 
where standardised tests scores are reported on the class 
rosters that teachers receive at the beginning of the new 
year, some teachers interviewed said that they skimmed the 
scores noted those that deviated s,,arply from most other 
scores on the list, then visited counselors to check on the 
placement of the students in question. Thus, depending on 
the context — / e on the activity at hand and the range of 
in form a tion available— the scores of a given type of test 
may or may not meet teachers' practical needs. In those 
contexts where they do. teachers take them into account In 
those contexts where they do not, teachers generally 
disregard them. _ __ 

The points made in the foregoing discussion add 
further detail to the portrait of the teacher as practical rea- 
soner and decision maker. . __ _ 

Given the way the teacher s everyday world is orga 
nized standardized tests are often impractical as sources 
of information. The scores they provide cannot be used in 
the work that constitutes, da_y to day teaching— tracking 
students' progress Through units; adjusting instructor) to 
fit on going achievement, assigning i grades, etc But when 
practical circumstances allow and occasional practical 
needs arise, teachers do treat standardized test results 
as important information: Thus, viewe^ from within "the 
world known in common and taken for granted bv 
teachers, teachers' demeanor toward a d actions regard- 
ing standardized test scores make prac • cal sense: 

(4) Teachers' expl cit comments or. tests and testing 
orient to the routine tasks and practical circum- 
stances of teaching. 

The above evidence substant afing the concept of the 
teacher as practical reasoner and decision maker.is based 
on what teachers say that they do in using tests A slightly 
different form of evidence — what teachers report that they 
believe and thmk^raXiJ jesthe same concept in the field 
work interviews, teachers' remarks repeatedly called atten- 
tion to their need for tests that are immediately acces? 
ible, that are consonant with the material taught, and that 
produce results that are of value in light of the routine 
tasks they confront everyday. The following quotations arc 
illustrative of these points. 

• The (standardized test) is almost useless in. the 
spr ng, which ^s too bad. because I feel there is some 
valuable information there, progress and growth. But 
w_e_get the score the last week of school 

• That computer-processed data (on district, objective: 
based tests) can really be Used with those kids that 
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need help. It does a better job of ident.ifyi.n g.students 
arid student heeds ... I can how say 'the kid needs to 
work on. objectives 2, 3, 5,. and 9.' . . ....... 

• I don't fee! we heed to test, test, test but if the 
information is something. j can use to prescribe ih : 
struction, then I don't really mind gjving it: 

• In. math, y.ou.krio_w, it's a good idea to keep them 
(tests) in my class: As long as testing stays «n math 
class Jt seems like it fits in, 'cause tests are part of 
taking math: . .. 

• In my class. I like to use the criterion-referenced 
tests of basic skills. The tests are geared to certain 
basic skills the book's developing — vocabulary, spell- 
ing, and writing. . _ 

• I don't Use (the district reading tests) unless there 
are results that completely throw me— like sjDmeone 
who usually does a good job completely, bombed. 
Then I'll do something about that, try to find some 
extra work to go over it: 

The orientation to assessment for all practical pur_ 
poses" that emerges in these fieldwork interview remarks 
also appeared in the reanalysis of Yeh's (1978) data. There, 
on a five point rating scale where 5 - "very important;" 
teachers rated the following considerations for selecting 
tests as high: test material is similarto what. I presented 
in class (X _= 4 5)_ the jest has clear format (X = 4.4) the 
test is simple to adm.mster and/or score <X = 4.2). These 
practical matters in test selection are consonant with pat 
terns of teachers' concerns and actions as reported 
throughout this section. 

Finally a slightly different dimension of teachers prac 
iical orientation to assessment appears in survey re 
sponses to attitude questions. On the survey question 
naires. large majorities of both elementary grade teachers 
(73° and high school English and mathematics teachers 
(80°o and 93° o, respectively) agreed that "testing motivates 
my students to study." 

(5) For given activities and decisions teachers most 
often use the results cf various types of assessment 
techniques collectively in a "clinical" way. 

The on site interviews indicated that teachers most of 
ten consider the results of several types of assessment 
techniques in carrying out a particular task. 0[ the 351 
instances in which teachers interviewed cited their uses 
for. particular test scores and other assessment results, in 
237 cases the score and results were .used as one of many 
information sources (se>~ Tab|e A) Reanalysis of Yen s 
(1978) research discovered the same phenomenon. In both 
pieces of plannmg_research it also became evident that 
teachers often revise decisions made on the basis of test 



scores in light of their Ongoing experience With children in 
the classroom: Other research reports s.imjiar_ patterns. of 
action by teachers (e g t Airaslan, 1979; Cicourel & Kilsose, 
1963.; Leiter; 1974; Sairnon-Cox, 1980; Shumsky & Me hah, 
1974). 

Once again the results of the national survey substan 
tiate these earlier findings: This is indicated in the distribu- 
tion of survey responses to t_hos_e questions that asked 
teachers to report on the importance of_d Liferent iype.s.of 
assessment mfor^atiom (Rejer to Tables 5 and 6) 
Extremely high proportions of both elementary and sec: 
ondary teachers reported giving at least some importance 
to each type of information listed under three of the dec) 
siqn making activities previously discussed initial plan 
ning initial grouping and placing of students for mstruc 
t_ion ; and reassignment of students to different groupings 
and curricula One need not examine the response pat 
terns of individual teachers, then, to ascertain that, the 
vast majority of them take a wide variety of kinds or as 
scbsment information into account in . making each of 
these three types of instructional decisions A glance at 
Table 7 shows more: Not only do survey respondents indi- 
cate that they cons_ult several sources of information on 
students' achievement in making a particular instructional 
decision, they also report thinking that n any kinds of as- 
sessment techniques give them crucial and/or important 
information for that decision 

Put another way, it does not seem as if_ teachers base 
their decisions primarily on one kino of assessment infor- 
mation then look to others merely for confirmation or the 
sake of form. Rather, they appear to weigh various kinds of 
data on student achjevement coMectively and to make 
sense of what it means more-or-less holistically. If this. is 
the case, it is apractice typical of clinical professions. The 
sociologist Homans (1955) long ago pointed out: 

Clinical science is what a doctor uses at his patient s 
bedside There, the doctor cannot afford to leave out of 
account anythingjn the patjent s condition that he can 
see or test , : . !t may be the cine to the complex , . . In 
action we must always be clinical An analytical sci- 
ence is for understanding but not for action. 

More recently Friedson (1970) has outlined other features 
of what he calls the ' clinical mentality Noting with 
Hon ans that the aim of the cljmcal practitioner is hot 
knowledge but action," Friedson goes on to point out that 
the clinician 

cannot suspend action in the absence of incontro- 
vertible evidence or be skeptical of himself, his 
experience, his work and its fruit: 



Table 4 



l n sLan c As_ 

Mentioned by 
44 Teachers 




Overall Patterns of Assessment 
Results Use: interview Data 



Functional Importance 



Sole Source of One of One of 

information Several Major Many 
Consulted Sources Sources 



Verifi- 
cation Not 
Source Used 



18 

(5.1%) 



65 
(18.5%) 



237 10 21 

67.5%) (2:8%) (6:0%) 



Total 

351 
(106%) 
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Tabie 5 



Percentages of Elementary Teacher Respondents indicating Use of Information as 
"Somewhat important," "important," or "Crucial" for Each Task 



Source/Kind of Information 



Planning Teaching Changing a_Student _ Deciding on 

a t B eg i nning of Initial Grouping f rdm O he G rou p or St tide n t s ' Report 
School Year- - of Students- Curriculum to Another 



Previous teachers' comments, 
reports, grades 

Students' standardized test scores 

Students scores on district con 
tinuum or minimum competency 
tests 



My previous teaching experience 

Results of tests included with 
curriculum being used 

Results of other special 
placement tests 

Resu.ts of special tests developed 
or chosen by my school 

Results of tests I mai;3 up 

My own observations and students' 
classroom work 



93 

92 
92 

100 

x 



75 

91 
91 



98 
96 



96 
99 



89 
90 

x 

97 

x 

96 

97 
100 



43 
55 



x 

93 



81 

99 
100 



Thus, Friedsdri continues the clinician is prone in time to 
trust his own personal first-hand experience" (c.f M Becker, 
et al . 1961) and to be " particularistic," emphasizing the 
uniqueness of individual casas. The clinical rationality, 
then, "is particularized and technical: it is a method of 
sorting the enormous mass of concrete data confrrr.^n^ 
[the practitioner] in individual cases" (Friedson, 1970, p. 

171). _ _ 

This same mentality is evident in teachers' routine re- 
liance upon and primary trust in thej r j)ersonaK interacjive 
experience with children in the classroom, as well as in 
their tendency to t rea t man y t ypes of assessment data as 
equally relevant. The clinical mentality is also evident in 
many interviewees' explanations of why the results of one 
test or one type of test— or even of tests in general — can- 
not be trusted without reference to everyday evidence. 

• I don't rely heavily on a lot of the test scores because 
I find that . . . some students are test takers and 
others are not . ... some students can handle the 
format, the time limit, (but in many cases) students 
are capable of more, than the test scores. show. 

• I hate to say it, but I d say about a third of these stu- 
dents don t give it their best shot They feel there's 
nothing in it for them. There's no grade for it; there's 
no use for it — so they don't care. 

• If I see there are certain kids having trouble I may 
look at their folders and fine 1 out (more) about them. 
But I try not to be swayed by somebody else's judg- 
ment.. . . I may get more out of them by what I'm tell- 
ing them and trying to motivate them to do better 
than they've ever done before. 
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• You can't count on a score on one test too heavily:, 
The kid could be sick or tired or just not fe3ling up to 
doing it that day. Maybe his parents had a fight the 
night before. Maybe he doesn't test well. 

i ' u, nbers of [o\ her resp^qnden[s voiced eq uivalenj dpi nion s. 

Similar reasoning appeared when teachers' opinions of 
tn £ _ f 3_ c * _° r s_w hi c h can in f [Lie ri c e test s c o res were el i c i t ed i ri 
a closed-end format in Yen's (1978). questionnaire study. 
Oil a ( ive point rating scale (where 5 = "great influence" 
on tesi scores), among the factor " for which teachers rated 
influence as 3.0 or higher were tne following: students' 
test taking skills (X = 4.4), test directions content, formal 
physical characteristics, student motivation (x! - 4.3); 
unusual circurr stances — special activities distractions (X 
= 4.2); and parent interest (X = 3.0). Teachers' belief that 
part i c u I a r i s t i c_ features of the test, the testing situation, 
and the students can and do mediate test results and their 
appropriate interpretation is reflected again here. 
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Part of what ■•everyone knows" in. the world or educa- 
tional practice, tnen, is that Atudsnts* vary as tes. t .. tak6rs 
and that a variety of situational factors can influence. stu- 
dents tes* performance. Better then to rely on a variety of 
sources of information — especially one's day-to-day, first; 
hand observations of and interactions with the individual 
across d variety of recurrent performance. settings in the 
classroom — arid to make sense of all the data at hand in 
this, situation' in light of one's practical knowledge and 
drie's clinical experience, 2 or so teachers apppear to 
reason. 

Summary 

A var ety of routine Jasks consti ■ ute? the world of -each 
ing as-practiced: Teachers must accomplish these tasks in 
a contex characterized by r°current time limits, others 
demands for high performance and accountability at those 
deadlines, arid teachers' own concerns with providing ef- 



fective and_appropriate instruction These features of the 
world of teaching-as-practiced jmpjn§e_ upon teachers' 
testina_practices and test use Teachers^ reasoning and 
decision making about, assessment andjts uses .are struc- 
tured by and oriented to their practical circumstances. 

The purposes for which teachers use assessr Ti e nt re * 
suits most often are those inherent in the most central 
activities of teaching, asjt js_practiced determining what 
to teach and how to teach it in general and to various class 
members in particujar, determining from day to day 
whether what the Y teach is being learned and adjusting in- 
struction as necessary to be sure it is t arid giving students 
orades so that they and their parents will know how they 
are doing The role of the teacher includes: other, optional 
tasks and responsibilities But especially jn view of the cur- 
rent ethos of meeting individual learners' needs, the cen- 
tral activities cited above are the essential, constitutive 
activities of classroom teaching For those purposes less 
intimately connected with the central work of teaching, 



Table 6 



Percentages of High School leacher Respondents Indicating Use of Information cS 
"Somewhat Important," "Important, " or "Crucial" for Each Task 

Planning Teaching Changing a Student 

at Beginning of Initial Grouping from One Group or 

School Year of St udents Curriculum to Another 

Source/Kind of information 



Deciding oh 
Students' Report 
Card 



Previous teachers' comments, 
reports; grades 

Students' standardized test scores 

Students' scores on district con- 
tinuum or minimum competency 
tests 

My previous teaching experience 

Penults of tests included with 
curricuiuii, oemg accd 

Results of other special 
p'Dcement tests 

R es u It s of special tests developed 
or chosen by my school 

Results of tests I make up 

My own obs ^rvations and students' 
classroom work 



71 

77 
78 

100 

x 



75 

7 6 
78 



x 

83 
80 



97 
99 



86 
83 

x 

87 



84 

90 
100 



24 
26 



68 



61 

100 
99 



'Perhaps the data and the analysis presented here explain why an 
overwhelming percentage of teacher survey respondents, at bO«h 
the elementary and .secondary levels agree that minimum cor 
petency tests should be required of all students for promotion at 
certain grade levels or for. high school graduation (in agreement: 
elementary teachers, 58%; high school English and math 
teachers _8l% an<^_90% respectively), while simultaneously 
agreeing that icachers shoulo. npt_be held accountable for stu 
dents' scores on minimum cor: ■Mency or standardized achieve- 
ment tests. (Agreeing that teachers should not ce held, account: 
able _75% of Ihe elementary school teacher respondents and 
61% of both hign school English and High school math teachers.) 
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use of assessment results seems to occur less frequently. 
Action, . In the "world known in common and taken for 
granted" by teachers, is oriented to and constrained by the 

organizational features of daily classroom teaching. 

The tests teachers use most frequently are those that 
fit their prac tie a I cj rc u ms t an ces: for ma I a nd i nform a I me a- 
sures they themselves construct or seek out for the 
information they provide; curriculum-embedded tests that 
come with commercial or district materials. These are im- 
mediately acL3srib]e, proximal in intended purpose to the 
tasks termers must accomplish, and content-consonant 
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Table 7 



Percentages of Teachers Who Report Considering Many Types of Assessment information 

Critical/Important for Given Activities 



Number of.Sources of Information 
Given in Question on Survey 

N umber o f So urces Def ined as "Many" 
for Purposes of This Analysis 

Proportion of Elementary Teachers 
Who Indicated That at Least This 
Many Sources Functioned as Critical 
and/or Important for the Given Activity 

Proportion of High School Teachers 
Who indicated That at Lerst This 
Many Sources Functioned as Critical 
and/or Important for the Given Activity 



Planning Te|chjri§ initial Grouping 
atBeginning of or PJacement 
School Year of Students 



Changing Grouping 
or Placement 



Plcidirigori 
Report Card 
Grades 



50% 



33% 



71% 



47% 



62% 



49% 



40% 



20% 



with the material taught; The farther removed from these 
qualities that tests and testing features are. the less will 
ing teachers are to give them or to consider their results as 
important. 

_ The way in which teachers use tests fellows from their 
practical understandings of the scenic features" of their 
wo_rld_. They recognize— tacitly in their actions and often 
explicitly in their words— that performance varies with 
context and that many readings - of student achievement 
are better than few. Thas, they most often use results from 
many ass essment type s c ollec t ivel y t o acc omplish given 
purposes. Their immediate, recurring experience with chil- 
dren often overrides scores f r om paper-and-pen ci I 
instruments. 

Teachers' comments about tests and testing confjrm 
their orientation to the practical business of getting every- 
day tasks done in time and done well They speak of the 
need to diagnose, prescribe, and assess efficiently and ac- 
curately. They talk of the need for test directions and 
form a t s t ha t a re clea r ... An d they comment practically 
about the need to consider "extenuating circumstances," 
to pass on information "which is meaningful to 
everybody," and the like; 

Some Implications for Local Policy arid Practice 

If testing programs are to be useful for teachers and 
used in classrooms, they must take into account teachers' 
routine thinking and practices in. assessing students' 
achievement American educational organizations 
(schools, school districts, etc.) have been called "loosely 
coupled systems" {c.f., Deal, 1979; Meyer & Rowan, 1978; 
Montjoy & O'Toole, 1979). Schooling in the United States 
has been described as 4, p/e-industrial — a cottage 
Industry" (Dawson, 1977).. And teachers in classrooms 
hsve been likened to "street-level bureaucrats" (e.g., 
Weatherly & Lipsky, 1977), These similes call attention. to 
the relative autonomy of the classroom teacher in a rfiult!- 
\eye I ed deci si o n - ma king hierarchy— -a hierarchy in which 
participants at each level have interests and concerns that 
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only partially overlap, only sometimes coincide In such a 
system, innovation — such as the introduction of a new 
testing program — tends to be more enduring not when it is 
imposed from the top down, not when it is generated from 
the bottom up but when it is planned and implemented 
conLOinUy by participants at all levels (Berman & Mc- 
Laughlin, .1978): 

Conjointly planneo programs, _shgu Id incorporate 
features which are important to teachers. Our results indi- 
cate that teachers favor tests that are: 

(1) proximal to the everyday instructional tasks 
teac hers need to accomplis h: planning their teach- 
ing, diagnosing students' learning needs, monitoring 
t h e i r p r ogres s through the cur r i c u I urn - a s-taught, 
placing students in appropriate groupings and 
instruct ional prog rams, adj u sti h g t he[r teach i rij_ in 
light of students' progress, and informing parents 
and others about how students are doing; 

(2) consonant, from teachers' perspectives, with the 
curriculum that teachers are actually leaching; 

(3) im media tely accessible to teachers, so t ha t teachers 
can give them to students when the time seems 
appropriate and have results available promptly; 

(4) designed to include a variety o f performance "con- 

' i.e., different types of response formats and 

tasks: 

Many districts' ; and schools') testing programs fail to 
meet these criteria in one or more ways. When they do, 
they become simply an extra burden for teachers. Instruc- 
tional time is taken op in testing, but there are few cbn- 
c P jyv- 1 a in t ben ef it_s f o rjeacher s o r s tudent _s. j n ot her cases, 
districts (and sometimes schools) hope to meet the above 
criteria by developing sets of tests oriented to local curri- 
c.ular objectives: Bat the Test Use Project's interviews and 
f i el dw or k i n dicate t h at i n m any c a ses these obje ctives- 
based tests only seem to meet the criteria listed above. 
Thus, the experience of one district studied by the project 
may p rovide a useful example of how those criteria can be 
met. 
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A case in point. The mid western district in question 
tenroijmeni about 5,000) did not have vast resources. 
Nevertheless^ it involved teachers during the school year 
and especially during. the summer in building curricula and 
tests to accompany them. Teachers participated in sub- 
stantial. numbers. (And at the elementary level, they were 
the leaders of cross-grade-level teaching teams— leaders 
chosen by their colleagues.) _ 

The emphasis in these recurrent projects was. on curri- 
cu I ar objectives and instructional materials An effort was 
made to .select objectives and design materials that 
teachers found appealing and used Repeatea revisions of 
instructional materials and goals. in light of teachers' criti- 
cisms were part of this process Tests were designed to fit 
each curriculum— tests that met teachers' routine 
teaching needs Thus the curricular packages included 
pi icement tests, chapter and unit tests, and semester and 
end-of-year review tests or "finals/' These tests were also 
revised in response to teachers cnt'clsms during the de 
velopment process, which included as a final step using 
the curricula and tests in schools throughout the district 
on a pilot basis for a year. 

The tests th em selves were desi gned to be c o hi p uter 
scored and analyzed, using computers that the district had 
o_njinal|y purchased for computer assisted instruction in 
the high school: Teachers gave the tests at times they felt 
were appropriate turned them in for scoring, and received 
the analyzed results. within. a day or two. The results them- 
selves came in the form of a set of sheets, one for each 
student. Thesheet listed (1) each objective the test covered, 

(2) the number of items tnat assessed performance on 
each objective and (3) the number of ttems that the student 
passed and missed on each objective. At the top of the 
sheet was a paragraph listing the main types of_errprs that 
the student had made and stating just what problems the 
student seemed to _be_hayin§ L This_ was L based on an analy- 
sis of the q jestions missed and the- incorrect items 
chosen. 

Teacfiers reported that they and t heir colleagues rou- 
tmely used these tests^ Arid interview response patterns 
indicated that they spent less time designing, administer- 
ing, and scoring their own tests than teachers ;n other dis- 
tricts visited. Interviewees stated explicitly that they used 
these tests (1) because they fit so well with what they were 
actually teaching, (2) because they could be used flexibly, 
e.g., at any time, with one child or an entire class, 

(3) because scores came back promptly, and (4) because 
the analyses summarized information in a way that gave 
them precise diagnoses they could act on in placing stu- 
dents, in deciding who needed additional help on what 
skills, etc. In fact, the only complaint teachers had was 
that ?l! the tests were multiple choice tests. As one 
teacher put it^ "that s a problem, cause sometimes you 
wonder whether they can apply the skills or ideas in 
another way." 

In short, this district made considerable efforts to as- 
sure that its testing program was useful to and used by 
teachers. In so doing, its program for testing fulfilled three 
of the four criteria identified earlier: the tests were proxi 
mai, instructionally consonant, and immediate; but they 
had only one response mode. The program met district 
needs, too Semester and end-of-year finals functioned to 
indicate strengths and weaknesses of the students in par- 
ticular schools and in schools throughout the district from 
year to year. Thus, they served various evaluation and man- 
agement functions. 

Testing programs which take into account teachers' 
routine thinking _._nd_practices jn a^ss_e_ssjrigj__ students' 
achievement can probably take many shapes: Thecase de- 



scribed here is only one example. But it should be clear 
that programs of testing that ignore how teachers think 
and act toward student assessment can result in ineffi- 
ciency and teacher resentment. 
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Other Highlights from the Test Use Project 



Elementary teachers report that [esting in reading 
takes op aboat 13 hoars of student time each year, 
and that math testing takes up about 17 hours of 
student time annually. 

Secondary teachers report that testing in English 
and in math each take up about 25 hours of stu- 
dent time each year. 

Elementary school teachers report that about half 
their students' testing time is spent in testing re- 
el u S red by J pc a [, s t a t e^ or f ed er a I a g e hcj es ; second: 
ary teachers report that about one-quarter of their 
students' testing time is mandated. 
Teachers report thaLtesting and test-related mat- 
ters consume about 5-7 hours each week — about 
12% to. 15%. of their total work effort during and 
after school hours. 

Case study findings indicate that testing, across 
all subjects, takes up about 10% of students 1 an- 
nual classroom time. 



A majority of teachers favor minimum competency 
testing for promotion and high school graduation 
but, particularly where these are required, are con- 
cerned about their fairness for some students. 
A majority of teachers feel that, minimum com- 
petency tests affect the amount of time t_hey can 
spend teaching sabjects not covered by the tests: 
Most t eac he r s rep o_ r t that they do n c it r •» c e i ve staff 
development training or other assistance in select- 
ing or developing good tests or in using tests to im- 
prove instruction . 

Survey findings indicate that administrative sup- 
port for testing exemplified in prmcipai interest, 
available resources, and/or opportunities for staff 
development training influence teachers atti- 
tudes toward and use of testing. 



eSE and the betA research community are sad to 
report the death of Bruce Choppin, lOrmerly director 
of the eSE methodology program: We extend our 
sympathy to family and friends. 

We are also saddened by the death of Ronald Ed- 
monds, of Michigan S.tate University, who served as a 
visiting scholar to CSE this year. 
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